High Capacity Associative Memory Models with Bipolar and Binary, Biased Patterns
نویسندگان
چکیده
The high capacity associative memory model is interesting due to its significantly higher capacity when compared with the standard Hopfield model. These networks can use either bipolar or binary patterns, which may also be biased. This paper investigates the performance of a high capacity associative memory model trained with biased patterns, using either bipolar or binary representations. Our results indicate that the binary network performs less well under low bias, but better in other situations, compared with the bipolar network.
منابع مشابه
High Capacityassociative Memory Models – Binary and Bipolar Representation
Hopfield type associative memory networks usually use a bipolar representation. It is also possible to use a binary 0/1 representation, although in the standard model this lowers performance. This paper reports an empirical investigation into the performance of both binary and bipolar associative memories, trained using the simple perceptron learning rule. Such networks normally have much bette...
متن کاملIterative retrieval of sparsely coded associative memory patterns
We investigate the pattern completion performance of neural auto-associative memories composed of binary threshold neurons for sparsely coded binary memory patterns. Focussing on iterative retrieval, eeective threshold control strategies are introduced. These are investigated by means of computer simulation experiments and analytical treatment. To evaluate the systems performance we consider th...
متن کاملStoring and restoring visual input with collaborative rank coding and associative memory
Associative memory in cortical circuits has been held as a major mechanism for content-addressable memory. Hebbian synapses implement associative memory efficiently when storing sparse binary activity patterns. However, in models of sensory processing, representations are graded and not binary. Thus, it has been an unresolved question how sensory computation could exploit cortical associative m...
متن کاملAssociative Memory Models with Structured Connectivity
High capacity associative memory models with dilute structured connectivity are trained using naturalistic bitmap patterns. The connectivity of the model is chosen to reflect the local spatial continuity of the data. The results show that the structured connectivity gives the networks a higher effective capacity than equivalent randomly diluted networks. Moreover the locally connected networks ...
متن کاملA Neuronet Algorithm for Recognizing a Large Number of Highly Correlated Patterns
The paper gives a simple algorithm that allows us to eliminate correlation between input binary patterns by changing their dimensionality. A neural network that is a variant of vector associative memory is used to recognize redimensioned patterns. Having capacity much greater than conventional neural networks, the resulting associative memory can recognize highly noisy and correlated input patt...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007